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(57) A computer readable storage medium being 
capable of recording a large amount of still picture (1) 
data thereon, allowing users to make a search based 
on recording times, and reducing the data size of record- 
ing time information, a recording apparatus, and a play- 
back apparatus. When recording still pictures on a large- 
capacity storage medium, management information on 
recording times becomes so large that it becomes hard 
for the recording apparatus and the playback apparatus 
to process. To minimize the amount of data for manag- 
ing still picture recording times, N (N is an integer equal 
to or larger than 1 .) still pictures are grouped and, for 
each group, a first still picture recording time 
(F_RECTM) (7) and a last still picture recording (8) time 
are recorded as management information. 
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Description 



[0001] The present invention relates to a rewritable 
storage medium, a recording apparatus and a playback 
apparatus for use with the storage medium, a method 
for recording data on the storage medium, and to a com- 
puter program executing the recording method. More 
particularly, the present invention is adaptive to, and 
preferably used with, an optical disc on which a large 
amount of still picture data is recorded. 
[0002] Large-capacity, rewritable optical disc record- 
ing media, such as DVD-RAMs or DVD-RWs, have been 
made available, and many technologies for recording 
picture data or audio data on the media are now being 
developed. Video data coded, for example, in the MPEG 
(Moving Picture Experts Group) system described in the 
ISO/IEC11172 or ISO/IEC13818 standard is usually 
used. Still picture data coded in the intraframe compres- 
sion method (I picture) of the MPEG (Moving Picture Ex- 
perts Group) system or in the JPEG system described 
in the ISO/IEC10918-1 standard is usually used. 
[0003} Digital VCRs(digital video cassette recorders) 
using magnetic tapes as recording media or electric still 
cameras using memories such as a flash memory as 
recording media are already in practical use for storing 
coded video or still pictures with audio. 
[0004] Recording apparatuses using optical discs as 
recording media, such as DVD-RAMs, have many ad- 
vantages over conventional digital VCRs or electric still 
cameras in that they feature random accessibility which 
cannot be attained by magnetic tapes, large-capacity 
which cannot be achieved by memories such as a flash 
memory, and a low cost per bit. Therefore, recording ap- 
paratuses using optical disc media allow the userto play 
back data independently of the sequence in which data 
was recorded and to process as many as tens of thou- 
sands of still pictures. For this reason, optical disc re- 
cording media are expected to be widely used as new 
AV (audio-visual) recording media. 
[0005] A DVD-RAM disc allows moving pictures and 
still pictures to be mixed. Especially, for still pictures, a 
huge number of still pictures which cannot be recorded 
by a conventional electric still camera can be recorded. 
For example, a 4.7 GB DVD-RAM disc can record ther- 
eon about 64,000 still pictures each of which is an 
MPEG-coded still picture (I picture) of about 80 KB. 
[0006] Unlike a storage medium such as a digital VCR 
tape from which data is played back in the order in which 
it was recorded, an optical disc medium such as a 
DVD-RAM disc allows the userto access data randomly. 
For data to be accessed randomly, management infor- 
mation, such as the addresses and sizes of still picture 
data as well as the playback times of audio data record- 
ed with still pictures are recorded. 
[0007] Playing back still pictures with a playback ap- 
paratus requires two steps. First, a still picture data ad- 
dress and so on are read from the management data 
recorded on the optical disk medium, and then still pic- 




ture data recorded at ^HC^^^ at was read is 
played back. Therefore, wherV^B ft|^a plurality of 
still pictures, each still picture req^K&J^bove two 



5 [0008] Also, recording still pictures and so t6 

an optical disc with a recording apparatus requires t\.. 
steps. First, still picture data is recorded, and then man- 
agement information such as the still picture data ad- 
dress is recorded. Therefore, when recording a plurality 

10 of still pictures, each still picture requires the above two 
steps. 

[0009] The optical disc recording or playback appara- 
tus has an optical head for recording and playing back 
information. This optical head is slow in accessing data 

15 because it is larger and heavier than a magnetic head. 
Therefore, playing back or recording a plurality of still 
pictures, which requires two steps, takes long and the 
apparatus cannot perform random access quickly. 
[0010] To solve this problem, the optical disc record- 

20 ing apparatus and the playback apparatus store man- 
agement information, read from the optical disc, into 
memory. Once the management information is stored 
into memory of the playback apparatus, the apparatus 
need not read management information from the disc 

25 each time it plays back a still picture, thus reducing the 
time needed to playback a plurality of still pictures. Also, 
the recording apparatus stores management informa- 
tion about a plurality of still pictures into the memory of 
the apparatus and records the management information 

30 onto the disc at a tjme. This eliminates the need to 
record management information each time a still picture 
is recorded, thus reducing the time needed to record a 
plurality of still pictures. 

[0011] However, because a large-capacity storage 

35 medium such as a DVD-RAM records tens of thousands 
of still pictures thereon, the amount of management in- 
formation on recorded still pictures becomes very large 
and a large amount of memory capacity is needed in the 
apparatus. Although the memory price has gone down 

40 recently, it is difficult to install megabytes of memory on- 
to an AV apparatus. In addition, considering the memory 
backup provided for use at emergency, it is unrealistic 
for an AV apparatus to process megabytes of manage- 
ment information. 

45 [0012] To solve this problem, a technology is dis- 
closed in the specification of the European Patent Ap- 
plication No. 99304691 .1 filed on June 16, 1999 or the 
corresponding U.S. Patent Application No. 09/332,882 
filed on June 15, 1999 by some of the inventors of the 

so present invention. To prevent an increase in the man- 
agement information size, the technology disclosed in 
the above patent application records management in- 
formation, such as data addresses and sizes or audio 
data playback times, in variable-size management in- 

55 formation tables proportional in size to the number of 
still pictures or the number of audio data pieces. 
[0013] However, the technology described above 
does not take the following into account. First, the tech- 
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nology does not support the function to manage still pic- 
ture data recording times. Because the technology de- 
scribed above does not support a search for data with 
the use of recording times, there is a problem with 
processing a request to search a huge number of still 
pictures for a desired still picture. 
[0014] For example, as shown in FIG. 3, when a re- 
cording time (RECTM) is represented by a 7-byte data 
structure composed of the year (2 bytes), month (1 
byte), day (1 byte), hour (1 byte), minute (1 byte), and 
second (1 byte), adding the recording time (RECTM) to 
each of about 64,000 still pictures requires that the data 
size of the management information used by the above- 
described technology be increased by as many as about 
438K bytes (=64,000X7). 

[0015] As mentioned above, the system controller 
within the apparatus should have the management in- 
formation always in its own memory for quick random 
access. To reduce the memory size (cost reduction) of 
AV apparatuses, that is, to reduce the cost, the data size 
of the management information must be minimized. 
[001 6] It is a first object of the present invention to pro- 
vide a recording apparatus and a playback apparatus, 
primarily used for optical discs, which allow the user to 
search for data based on recording times and which 
have a data structure preventing the data size of man- 
agement information from increasing, and computer 
programs which control these apparatuses. 
[0017] Second, the technology does not support the 
function to solve problems associated with still picture 
deletion. 

[0018] FIG. 12 shows the still picture management 
method according to the technology described above. 
First, still picture group management information (VOB- 
Gi) 103 is provided to manage a plurality of still picture 
data pieces (VOB) 101 as a still picture group (VOBG) 
102. The still picture group management information 
(VOBGI) 103 comprises still picture group identification 
information (VOBGJD) 1 04, start and end address in- 
formation (VOBG_Address) 105 on the still picture 
group (VOBG) 102, number-of-pictures information 
(V_l_Number) 1015 representing the number of still pic- 
tures managed in this group, picture management infor- 
mation table (V_l_Table) 1016 containing only picture 
management information (V_l) 1017 on the pictures of 
the still picture data (VOB) 101, number-of-audio-data 
information (AJ_Number) 1018 representing the 
number of audio data pieces managed in this group, and 
audio management information table (A_l_Table) 1019 
containing only audio management information (A_l) 
1020 on the audio data. The picture management infor- 
mation (VJ) 1017 comprises an picture data size 
(V_Size) 1021 and audio pointer information (A_I_PTR) 
1 022 providing a link to the audio management informa- 
tion (A_l) 1020 corresponding to the audio data to be 
played back in synchronization with the picture. The au- 
dio management information (AJ) 1020 comprises au- 
dio data address information (A_Address) 1023, audio 




data size (A_Size) 1024, auuf^lfc^ck time (A_PTM) 
1025, and audio pointer InformtJ^V. I_PTR) 1026 
providing a link to other managemetu . 4 lation (AJ) 
1020. When there is no audio data to be nnkud, NULL 
5 is recorded in the audio pointer information (AJ_PTR) 
1022, 1026 to indicate an invalid value. 
[001 9] The technology described above has two sep- 
arate tables: picture management information table 
(VJJTable) 1016 and audio management information 
10 table (AJ_Table) 1 01 9. In addition, the audio manage- 
ment information (AJ) 1020 contains audio data ad- 
dress information (A_Address) 1 023. 
[0020] Still picture data and audio data are recorded 
in files on the storage medium. Because the addresses 
15 in the file are contiguous, deleting a still picture and the 
audio data synchronizing with it causes the file to be re- 
structured to close up the deleted part and to make the 
addresses contiguous within the file. Therefore, when 
the recording position of audio data is managed by the 
20 audio data address information (A_Address) 1 023 with- 
in the file, all the audio data address information 
(A_Address) 1 023 after the deleted part must be re- 
placed with new address information generated after re- 
structuring. This will require a very long time for replac- 
es ing address information when tens of thousands of still 
picture data are recorded. 

[0021] Another way to get address information is to 
simply delete the address information 1023 from the 
management information shown in FIG. 12 and then to 

30 add up the picture and audio data sizes 1 021 , 1 024 be- 
ginning with the start, as shown in FIG. 13, (a). 
[0022] Although this method eliminates the need for 
address replacement after restructuring described 
above, following problem arises. 

35 [0023] For example, assume that two different data 
structures described below occur in the file. One data 
structure, shown in FIG. 1 3, (b), is composed of the vid- 
eo part (V_Part #1) 1027 of still picture #1, followed by 
the post-recorded audio part (A_Part #1) 1028 of still 

40 picture #1 , followed by the video part (V_Part #2) 1 029 
of still picture #2. Another data structure, shown in FIG. 
13, (c), is composed of the video part (V_Part #1) 1030 
of still picture #1 , followed by the video part (V_Part #2) 
1031 of still picture #2, followed by the post-recorded 

45 audio part (A_Part #1 ) 1 032 of still picture #1 . Although 
the data structures differ, management information table 
entries are created as shown in FIG. 13, (a). That is, VJ 
#1 (1 01 7-1 ) in the picture management information table 
(V_l_Table) 1016 comprises the picture data size 

50 (V_Size #1) 1021-1 of V_Part #1(1027) or V_Part #1 
(1030) and the audio pointer information (AJ_PTR) 
1 022-1 providing a pointer to A_Part #1 (1 028) or A_Part 
#1(1032). VJ #2(1017-2) comprises the picture data 
size (V_Size #2) 1021-2 of V_Part #2(1029) or V_Part 

55 #2(1 031 ) and audio pointer information (NULL) 1 022-2 
indicating that there is no audio data to be linked. AJ 
#1(1020) comprises the audio data size (A_Size #1) 
1024 of A_Part #1(1028) or A_Part #1(1032), audio 
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playback time (A_PTM #1) 1025, and audio pointer in- 
formation (NULL) 1026 indicating that there is no audio 
data to be linked. Therefore, these two cannot be dis- 
tinguished. 

[0024] In addition, the configurations of the picture 
management information (V_l) (1017) and the audio 
management information (A_l) (1020) shown in FIG. 12 
are redundant. The data sizes may further be reduced. 
[0025] It is a second object of the present invention to 
provide a recording apparatus and a playback appara- 
tus for use with an optical disc with a data management 
structure capable of managing stili picture data and au- 
dio data to be played back in synchronization the still 
picture data without any problem, significantly reducing 
the time needed to re-configure the management infor- 
mation when still pictures are deleted, and reducing the 
management information sizes. 

In the drawings: 

[0026]^ Fig. 1 is a diagram showing the configuration 
of a fir^ embodiment of the present invention. 
[0027] FIG. 2 is a diagram showing the structure a di- 
rectory used in the first embodiment of the present in- 
vention. 

[0028] FIG. 3 is a diagram showing the structure of 
time information used in the first embodiment of the 
present invention. 

[0029] FIG. 4 is a diagram showing the configuration 
of a second embodiment of the present invention. 
[0030] FIG. 5 is a diagram showing the structure a di- 
rectory used in a third embodiment of the present inven- 
tion. 

[0031] FIG. 6 is a diagram showing the configuration 
of the third embodiment of the present invention. 
[0032] FIG. 7 is a diagram showing the configuration 
of a fourth embodiment of the present invention. 
[0033] FIG. 8 is a diagram showing the configuration 
of a recording/playback apparatus of the present inven- 
tion. 

[0034] FIG. 9 is a diagram showing an example of the 
still picture recording method according to the present 
invention. 

[0035] FIG. 10 is a diagram showing an example of 
the still picture playback method according to the 
present invention. 

[0036] FIG. 1 1 is a diagram showing the configuration 
of an embodiment of the present invention. 
[0037] FIG. 12 is a diagram illustrating a technology 
proposed by the inventor and his group. 
[0038] FIG. 13 is a diagram illustrating the technology 
proposed by the inventor and his group. 
[0039] FIG. 1 4 is a diagram showing the detailed con- 
figuration of the embodiment of the present invention. 
[0040] FIG. 15 is a diagram showing an example of a 
file used in the embodiment of the present invention. 
[0041] FIG. 16 is a diagram showing the configuration 
of the embodiment of a recording/playback apparatus 



according to the present invention. 
[0042] FIG. 17 is a diagram showing an example of 
recording method used in the present invention. 
[0043] FIG. 18 is a diagram showing another example 
5 of recording method used in the present invention. 
[0044] FIG. 19 Is a diagram showing an example of 
playback method used in the present invention. 
[0045] FIG. 20 is a diagram showing the configuration 
of the embodiment of the recording/playback apparatus 
10 used in the present invention. 

[0046] An embodiment of the present invention which 
achieves the first object will be detailed. 
[0047] FIG. 1 shows the configuration of a first em- 
bodiment of the present invention. In the figure, N (an 
15 integer equal to or larger than 1) still pictures (VOB) 1 
coded, for example, in the I picture compression method 
of MPEG are grouped into one still picture group 
(VOBG) 2. Group generation is controlled so that the 
next still picture group (VOBG) 2 is generated when the 
number of still pictures (VOB) 1 of the still picture group 
(VOBG) 2 reaches a predetermined value (for example, 
64) during still picture recording or when the operation 
mode is switched from video recording mode to still pic- 
ture recording mode. Data (coded stream data) of the 
still pictures (VOB) 1 is recorded on a storage medium 
as a VOB file 11 which will be described later, while in- 
formation used to define the still picture groups (VOBG) 
2 is recorded on the storage medium as a VOB man- 
agement file 12. 

[0048] The VOB management file (VOBGI) 12 com- 
prises management information (VOBGI) 3 correspond- 
ing to each still picture group (VOBG) 2. That is, each 
still picture group (VOBG) 2 has its own management 
information (VOBGI) 3 in this file. Note that information 
used to manage M (an integer equal to or larger than 1 ) 
pieces of management information (VOBGI) 3 may be 
provided separately in the VOB management file (VOB- 
GI) 12. This information is not shown in the figure. The 
management information (VOBGI) 3 comprises a still 
picture group identifier (VOBGJD) 4, number-of-VOBs 
information 5, a VOB map 6, a first recording time 
(F_RECTM) 7, and a last recording time (L_RECTM) 8. 
Each entry will be described below. 
[0049] The still picture group identifier (VOBGJD) 4, 
a unique value in the VOB management file 12, identi- 
fies each piece of management information (VOBGI) 3 
and the corresponding still picture group (VOBG) 2. Se- 
rial numbers beginning with the start of the VOB man- 
agement file 12 may be used for this information, in 
which case the still picture group identifier (VOBGJD) 
4 may be omitted. 

[0050] The number-of-VOBs information 5 indicates 
the number of still pictures (VOB) 1 of the still picture 
group (VOBG) 2. This number-of-VOBs information de- 
termines the data length of the VOB map 6 which will 
be described below. 

[0051] The VOB map 6 contains information on the 
address 9 and the attribute (10) of each stili picture 
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(VOB) 1 . Note that it is also possible to store data sizes, 
instead of addresses 9, and to find the address of a de- 
sired location by add up (summation) the data sizes be- 
ginning at the start and ending at the address immedi- 
ately preceding the location. The attribute (10) includes 
the number of horizontal and vertical pixels of the still 
picture, still picture display time, whether or not there is 
audio to be played back in synchronization with the still 
picture, audio play back time, and audio data address. 
[0052] Although the recording time (RECTM) of each 
still picture (VOB) 1 may be stored as management in- 
formation as described above, this method makes the 
data size of management information too large. The first 
recording time (F_RECTM) 7 and the last recording time 
(L_RECTM) 8 are one of characteristics of the present 
invention. Therefore, to reduce the data size, the record- 
ing times (RECTM) are stored for each still picture group 
(VOBG) 2 which groups N (an integer equal to or larger 
than 1) still pictures (VOB) 1. In addition, storing both 
the first recording time (F_RECTM) 7 and the last re- 
cording time (L_RECTM) 8 of the still picture recording 
times (RECTM) of the still picture group (VOBG) 2 
makes it possible to make a search with a time as the 
key. That is, when the user enters the recording time 
(TM) of a still picture to be played back or searched for, 
only the still picture group (VOBG) 2 corresponding to 
the recording time (TM) is selected for playback or 
search. That is, only the still picture group (VOBG) 2 
whose TM is equal to or later than F_RECTM and equal 
to or earlier than L_RECTM (F_RECTM(7)^TM^ 
L_RECTM(8)) is selected. According to the present in- 
vention, the data management structure shown in FIG. 
1 , when recorded on the optical disc, eliminates for the 
user to search the maximum of about 64,000 still pic- 
tures for one desired still picture. Instead, it allows the 
user to search the maximum number of still pictures (for 
example, 64) of a still picture group (VOBG) for the de- 
sired still picture. Therefore, usability is significantly in- 
creased. 

[0053] FIG. 2 shows an example of directory structure 
used in the first embodiment of the present invention. 
On recording media such as a DVD-RAM, coded stream 
data such as still pictures, management information, 
and so on are recorded as files containing logically-re- 
lated data. A storage medium, with a directory structure 
beginning at a root directory 13, usually has the above- 
described VOB file 11 and VOB management file 12 
generated and stored in a sub-directory 14. Note that, 
instead of using the sub-directory 14, the VOB file 11 
and the VOB management file 12 may be recorded di- 
rectly below the root directory 13. The file 11 and the 
VOB management file 1 2 may also be stored in another 
sub-directory which is below the sub-directory 14. 
[0054] FIG. 3 shows the structure of time information 
used in the first embodiment of the present invention. 
The figure shows an example of the data structure of a 
recording time (RECTM) represented by a 2-byte for 
year 1 5, 1 -byte for month 16,1 -byte for day 1 7, 1 -byte 



for hour 1 8, 1 -byte for minute 1 9, and 1 -byte for second 
20. This data structure may be used also for the first 
recording time (F_RECTM) 7 and last recording time 
(L_RECTM) 8 described above. This data structure, if 

5 used for the still picture group (VOBG), requires only 14 
additional bytes for F_RECTM and L_RECTM. Thus, 
even if the maximum of about 64,000 still pictures are 
recorded, with each 64 pictures grouped as a still picture 
group, this data structure requires about only 14K bytes 

10 (=(64,000X1 4)/(64xl ,024)) of additional space for the 
management information. As compared to the above- 
described technology in which a recording time is ap- 
pended to each still picture and therefore the manage- 
ment information is increased by as many as about 

15 438K bytes, the embodiment of the present invention 
increases the management information only by about 
3%. 

[0055] This reduces the amount of management in- 
formation and the amount of memory that must be in- 

20 stalled in the recording/playback apparatus, thus in- 
creasing the access speed while reducing the cost. 
[0056] It should be noted that the present invention is 
not limited to the data structure shown in the figure but 
that the recording time may be represented by a data 

25 structure represented by the numbers of bytes other 
than those shown above. In addition, the recording time 
may be represented by the total number of seconds be- 
ginning at a predetermined time (for example, 00:00:00 
on Jan. 1 st , 1990). 

30 [0057] FIG. 4 shows the configuration of a second em- 
bodiment of the present invention which achieves the 
first object of the present invention. The figure shows 
the management information structure which contains 
the recording time (RECTM) of each still picture data 

35 (VOB) on the optical disc medium but which reduces the 
amount of memory the system controller of the appara- 
tus must hold. Like the structure shown in FIG. 1, the 
management information (VOBGI) 3 comprises still pic- 
ture group identifier (VOBGJD) 4, number-of-VOBs in- 

40 formation 5, VOB map 6, first recording time 
(F_RECTM) 7, and last recording time (L_RECTM) 8. 
The management information (VOBGI) 3 further com- 
prises pointer information (RECTMI_P) 21 pointing to 
still picture recording time management information 

45 (RECTM I) 22. This pointer information (RECTM LP) 21 
points to the address within the VOB management file 
12 where the still picture recording time management 
information (RECTM I) 22 is stored and may further con- 
tain the data size of the still picture recording time man- 

50 agement information (RECTM I) 22. Also, with the still 
picture recording time management information (RECT- 
Ml) 22 as a file separate from the VOB management file 
12, the file name may be stored as the pointer informa- 
tion (RECTMLP)21. 

55 [0058] The still picture recording time management 
information (RECTM I) 22 contains the recording times 
(RECTM) 23 of the still pictures (VOB) 1 of each still 
picture group (VOBG) 2. In the example shown in the 
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figure, five still pictures (VOB) are grouped as a still pic- 
ture group (VOBG). The recording time (RECTM) may 
be represented by the data structure shown in FIG. 3. 
[0059] In this configuration, the system controller 
holds only the management information (VOBGI) 3 in its 
own memory. When the recording time of each still pic- 
ture data (VOB) is required, only the still picture record- 
ing time management information (RECTM I) of the still 
picture group (VOBG) to which that still picture (VOB) 
belongs is read into memory. Therefore, this configura- 
tion may reduce the size of required memory. For exam- 
ple, if the pointer information (RECTMLP) is 4 bytes, 
the maximum number of still pictures of a still picture 
group (VOBG) is 64, the maximum number of still picture 
groups is 1,000 (=64,000/64), and the recording time 
(RECTM) is 7 bytes, then the increase in required mem- 
ory is 4,448 bytes (=4x1 ,000+64x7). Thus, the total of 
this increase and the increase required for F_RECTM 7 
and L_RECTM 8 is about 4% of the increase (about 
438K bytes) according to the technology described 
above&j 

[0060]s| FIG. 5 shows the configuration of a directory 
used irra third embodiment of the present invention to 
achieve the first object. The recording times (RECTM) 
of still pictures (VOB) 1 are used primarily for search. 
Recording times are usually displayed with thumbnail 
pictures, which are reduced stiil pictures, for use in 
search. Thus, a THM file 24 storing therein thumbnail 
pictures to be searched for and a THM management file 
25 storing therein thumbnail picture management infor- 
mation, which will be described later, are added to the 
directory structure shown in FIG. 2. This allows the re- 
cording times (RECTM) of still pictures (VOB) 1 to be 
managed in the THM management file 25. Although the 
THM file 24 and the THM management file 25 are in the 
directory in which the VOB file 1 1 and the VOB manage- 
ment file 1 2 are stored, they need not be in that directory 
but may be in some other sub-directory. 
[0061] FIG. 6 shows the configuration of a third em- 
bodiment of the present invention. The figure shows 
how the recording times (RECTM) 32 of the still pictures 
(VOB) 1 are stored in the THM management file 25. Like 
still picture management information (VOBI) 26 for man- 
aging still pictures (VOB) 1 , thumbnail management in- 
formation (THM I) 29 for managing thumbnail pictures 28 
need not reside in memory. It need only be read into 
memory at search time. Therefore, with the recording 
times (RECTM) 32 recorded in the thumbnail manage- 
ment information (THMI) 29, there is no needto increase 
the amount of memory the system controller must hold. 
At the same time, because there is a one-to-one corre- 
spondence among still pictures (VOB) 1 , thumbnail pic- 
tures 28, and thumbnail management information (TH- 
MI) 29 as shown in the figure, the recording times 
(RECTM) 32 of the still pictures (VOB) 1 may be stored. 
In the figure, thumbnail identifiers 27, 30, each unique 
value in the VOB management file 12 and in the THM 
management file 25 respectively, are identification infor- 



mation for associating the VOB management informa- 
tion (VOBI) 26 with the thumbnail management informa- 
tion (THMI) 29. 

[0062] Serial numbers beginning with the start of the 
5 VOB management file 1 2 may also be used for thumb- 
nail identifiers 27, in which case thumbnail identifiers 30 
may be omitted. In addition, address information 31 on 
a position within the THM file, stored in the thumbnail 
management information (THMI) 29, allows the thumb- 
nail management information (THMI) 29 to be made to 
correspond to thumbnail pictures 28. In the method 
shown in the figure, each still picture (VOB) 1 must have 
its own still picture management information (VOBI) 26 
and therefore the size of the VOB management file 12 
residing in memory increases. This method may be im- 
proved as described below. 

[0063] FIG. 7 shows the configuration of a fourth em- 
bodiment of the present invention to achieve the first ob- 
ject. Like the method shown in FIG. 1 , N (N is an integer 
equal to or larger than 1.) still pictures (VOB) 1 are 
grouped into a still picture group (VOBG) 2, and the still 
picture group management information (VOBGI) 3 cor- 
responding to each still picture group (VOBG) 2 manag- 
es the group. In addition to the entries in the data struc- 
ture shown in FIG. 1 , the still picture group management 
information (VOBGI) 3 has pointer information 
(THMGLP) 33 pointing to thumbnail group manage- 
ment information (THMGI) 34 which will be described 
later. This pointer information (THMGLP) 33 points to 
the address within the THM management file 25 at 
which thumbnail group management information (THM- 
GI) 34 is stored. This information may also contain in- 
formation on the data size of the thumbnail group man- 
agement information (THMGI) 34 and the address name 
of the THM management file 25. 
[0064] The thumbnail group management information 
(THMGI) 34 is information for managing thumbnail 
groups (THMG) 40 each composed of L (L is an integer 
equal to or larger than 1.) thumbnail pictures 28. With 
the value of L made equal to the value of N indicating 
the number of still pictures (VOB) 1 of a still picture group 
(VOBG) 2, both groups synchronize with each other and 
therefore management becomes easy. All thumbnail 
group management information (THMGI) 34 is collected 
and recorded as the THM management file 25. 
[0065] The thumbnail group management information 
(THMGI) 34 comprises number-of-thumbnails informa- 
tion 35 and a THM map 36. The number-of-thumbnails 
information 35 indicates the above-mentioned integer L. 
When L is equal to N as described above, the number- 
of-VOBs information 5 in the still picture group manage- 
ment information (VOBGI) 3 may be used for L and 
therefore L may be omitted. The THM map 36 contains 
the address 37, attribute 38, and recording time 
(RECTM) 39 of each thumbnail picture 28. Note that, if 
the data size of a thumbnail picture (THM) is stored in- 
stead of the address (37), adding up the data sizes be- 
ginning at the start gives us the address of a desired 
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entry. The attribute 38 includes such information as the 
number of vertical and horizontal pixels and coding 
method; if they are fixed, the attribute may be omitted. 
[0066] The method described above, when used for 
making a search based on times, first finds the desired 
still picture group (VOBG) with the use of the first re- 
cording time (F_RECTM) 7 and the last recording time 
(L_RECTM) 8 of each group recorded in the still picture 
group management information (VOBGI) 3. Then, the 
method reads into memory only the thumbnail group 
management information (THMGI) 34 corresponding to 
the still picture group (VOBG). This prevents the mem- 
ory size of the system controller from increasing. For ex- 
ample, if the pointer information (THMGLP) 33 is 4 
bytes and the maximum number of still picture groups 
(VOBG) is 1 ,000 (=64,000/64), then the VOB manage- 
ment file becomes 4,000 bytes larger than that used in 
the method shown in FIG. 1 . If the maximum number of 
thumbnail pictures 28 of a thumbnail group (THMG) 40 
is 64, the number-of-thumbnails information 35 is omit- 
ted by setting L equal to N, the address 37 is 4 bytes, 
the attribute 38 is omitted, and if the recording time 
(RECTM) 39 is 7 bytes, then the size of the thumbnail 
group management information (THMGI) 34 is 704 
bytes (=64x(4+7)) for each group. Thus, as compared 
to the method shown in FIG. 1 , the addition of only 4,704 
bytes allows the recording time (RECTM) 39 of each still 
picture (VOB) 1 to be searched for. The total of this in- 
crease and the increase required for F_RECTM 7 and 
L_RECTM 8 (about 14K bytes) described above is 
about 4.3% of the increase (about 438K bytes) accord- 
ing to the method in which the recording time is recorded 
for each still picture. 

[0067] The thumbnail group management information 
(THMGI) 34 shown in FIG. 7 is thought of as information 
managing the recording time (RECTM) 39 of each still 
picture (VOB) 1 , meaning that it includes the functions 
of the still picture recording time management informa- 
tion (RECTMI) 22 shown in FIG. 4. Therefore, the point- 
er information (THMGI_P) 33 shown in FIG. 7 also in- 
cludes the function of pointer information (RECTMI_P) 
21 shown in FIG. 4. 

[0068] FIG. 8 is a diagram showing the configuration 
of an embodiment of the recording/playback apparatus 
according to the present invention. 
[0069] The recording/playback apparatus may be a 
special hardware unit or a general-purpose hardware 
unit such as a personal computer controlled by a control 
procedure (hereinafter called a program) which will be 
described later. In either case, a system controller 41 
performs operation according to the program stored in 
memory 101. The memory 101 where the program is 
stored may be the same storage medium as is used as 
memory 102 where the management information is re- 
corded. Or, they may be separately configured. For ex- 
ample, a storage medium for rarely-rewritten data, such 
as a read-only memory (ROM) or flash memory, is used 
for the memory 101, while a storage medium for fre- 



quently-rewritten data, such as a Dynamic Random Ac- 
cess Memory (DRAM) or a Static Random Access Mem- 
ory (SRAM), is used for the memory 1 02. The contents 
of the memory 1 01 where the program is stored may be 
5 preset by the manufacturer before shipping or, as shown 
in FIG. 11 , the program may be read from another stor- 
age medium (computer-readable storage medium) be- 
fore the apparatus starts operation. 
[0070] FIG. 20 shows an example of the recording/ 
playback apparatus configured according to the present 
invention. Referring to the figure, the recording/play- 
back apparatus comprises a computer system unit 
101003, a monitor 101001 on which pictures are dis- 
played, speakers 1 01 002 from which sounds are output, 
a mouse 1 01 004 and a keyboard 1 01 005 which receive 
user's instructions, and a disk drive 101006 which 
records data to, or plays back data from, a storage me- 
dium 1 01 007. The storage medium 1 01 007 stores ther- 
eon the program controlling the computer system unit 
1 01 003, and the program is read (installed) into memory 
1 01 01 of the computer via the drive 1 01 006 before the 
computer is used as a recording/playback apparatus. 
The storage medium 101007 is a read-only disc, such 
as a CD-ROM or DVD-ROM, or af loppy disk. In addition, 
a rewritable medium such as a DVD-RAM may be used 
as the storage medium 1 01 007 to allow the program and 
the picture/audio data to be mixed on the same medium. 
[0071] First, the recording/playback apparatus shown 
in FIG. 8 receives an operation instruction from the user 
through the user interface 42. The system controller 41 
starts operation control of the parts which will be de- 
scribed later. At recording time, an input unit 43 receives 
the picture signals and audio signals, and an encoder 
44 codes the signals using the MPEG system. Coded 
data such as video, still picture, and audio data is en- 
tered into a drive 46 via a track buffer 45 for recording 
onto a storage medium 47. At this time, the manage- 
ment information generated by the system controller ac- 
cording to the method shown in FIGS. 1 , 4, 6, and 7 is 
also recorded. 

[0072] While coded data is recorded in real time, it is 
difficult to record management information at the same 
time. Therefore, recording of the management informa- 
tion is controlled so that it is once recorded in the mem- 
ory 102 and then written onto the storage medium 47 
after the coded data is recorded. Reducing the size of 
the memory 1 02 is one of the objects of the present in- 
vention. 

[0073] On the other hand, at playback time, the drive 
reads the management information from the storage 
medium 47 into memory 102. Based on the manage- 
ment information that was read, the drive reads coded 
data into the track buffer 45. A decoder 48 decodes the 
coded data sent from the track buffer 45, and an output 
unit 49 outputs the decoded data. 
[0074] The following describes a computer-readable 
storage medium for executing the still picture recording 
method and the still picture playback method according 
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to the present invention, with emphasis on the operation 
of the system controlier 41 . 

. [0075] FIG. 9 shows an example of the still picture re- 
cording method according to the present invention. Re- 
cording starts in step 50. First, in step 51 , coded stream 
data of the still picture (VOB) 1 shown in FIG. 1 is re- 
corded on the storage medium as the VOB file 11 . Con- 
trol goes to step 52. 

[0076] In step 52, a check is made to see if the still 
picture group management information (VOBGI) 3 cor- 
responding to the still picture group (VOBG) 2 including 
the still picture (VOB) 1 already exists. If it exists, control 
goes to step 53; if not, control goes to step 58. 
[0077] In step 53, the number-of-still-pictures infor- 
mation in the still picture group management information 
(VOBGI) 3 is increased by 1 and the address 9 and at- 
tribute 1 0 of the still picture (VOB) 1 recorded in step 51 
is added to the VOB map 6. Control goes to step 54. 
[0078] In step 54, the recording time (RECTM) of the 
still picture recorded in step 51 is compared with the first 
recording time (F_RECTM) 7 of the still picture group. 
If RE^TM is earlier than F_RECTM (RECTM < 
F_RECTM), control goes to step 55; if not, control goes 
to step 56. In normal operation, although RECTM is nev- 
er earlier than F_RECTM, this comparison is required 
because the condition (RECTM < F_RECTM) may oc- 
cur, for example, when two or more recording appara- 
tuses share the same storage medium and there is a 
difference among the clocks built in the apparatuses. 
[0079] In step 55, the value of F_RECTM is replaced 
with the value of RECTM. That is, the value of 
F_RECTM is set to the earliest time in the still picture 
group. Then, control goes to step 56. 
[0080] In step 56, the recording time (RECTM) of the 
still picture recorded in step 51 is compared with the last 
recording time (L_RECTM) 8 of the still picture group. If 
RECTM is later than L_RECTM (RECTM > L_RECTM), 
control goes to step 57; if not, control goes to step 61 . 
In normal operation, although RECTM should be later 
than L_RECTM, this comparison is required because 
the condition (RECTM < L_ RECTM) may occur, for ex- 
ample, when two or more recording apparatuses share 
the same storage medium and there is a difference 
among the clocks built in the apparatuses. 
[0081] In step 57, the value of L_RECTM is replaced 
with the value of RECTM. That is, the value of 
L_RECTM is set to the latest time of the still picture 
group. Then, control goes to step 61. 
[0082] In step 58, new still picture group management 
information (VOBGI) 3 is generated. The number- 
of-VOBs information 5 is set to 1 , and the address 9 and 
the attribute 1 0 are set in the VOB map 6. Then, control 
goes to step 59. 

[0083] In step 59, the recording time (RECTM) of the 
still picture recorded in step 5 1 is set in the first recording 
time (F_RECTM) 7 of the still picture group. Control 
goes to step 60. 

[0084] In step 60, the recording time (RECTM) of the 



still picture recorded in step 51 is set in the last recording 
time (L_RECTM) 8 of the still picture group. Control 
goes to step 61 . 

[0085] In step 61 , the still picture group management 
5 information (VOBGI) 3 generated or updated described 
above is recorded on the storage medium as the VOB 
management file 12. The recording operation ends in 
step 62. 

[0086] FIG. 10 shows an example of the still picture 
10 playback method according to the present invention. 
The figure shows how only the still picture (VOB) 1 
whose recording time (RECTM) is near a desired time 
entered from a user interface 42 is selectively played 
back. 

*5 [0087] Playback starts in step 63. In step 64, a desired 
time (TM) is entered and control goes to step 65. 
[0088] In step 65, the first still picture group manage- 
ment information (VOBGI) 3 is selected for processing. 
In this case, the first still picture group management in- 

20 formation (VOBGI) is, for example, the still picture group 
management information (VOBGI) stored first in, and lo- 
cated at the beginning of, the VOB management file 12. 
Then, control goes to step 66. 

[0089] In step 66, the time (TM) entered in step 64 is 
25 compared with the first recording time (F_RECTM) 7 
and with the last recording time (L_RECTM) 8 in the still 
picture group management information (VOBGI) 3 se- 
lected for processing. If TM is equal to or later than 
F_RECTM and equal to or earlier than L_RECTM, that 
30 is, (F_RECTM<TM<L_RECTM) is satisfied, control 
goes to step 67; otherwise, control goes to step 68. 
[0090] In step 67, the still picture (VOB) 1 belonging 
to the still picture group (VOBG) 2 managed by the still 
picture group management information (VOBGI) 3 se- 
35 lected for processing is played back. Control goes to 
step 68. 

[0091] In step 68, a check is made to see if the next 
still picture group management information (VOBGI) ex- 
ists. If it exists, control goes to step 69; if not, control 

40 goes to step 70. In this case, the next still picture group 
management information (VOBGI) is, for example, the 
still picture group management information (VOBGI) 
stored following the still picture group management in- 
formation (VOBGI) currently selected for processing. 

45 [0092] In step 69, the next still picture group manage- 
ment information (VOBGI) is set to the still picture group 
management information to be processed next. Control 
goes to step 66. 

[0093] In step 70, the playback operation ends. 
so [0094] Through the above operation, only the still pic- 
tures (VOB) 1 belonging to the still picture groups 
(VOBG) satisfying the relation 

(F_RECTM<TM<L_RECTM) may be selectively played 
back. 

55 [0095] Although only DVD-RAM discs are used as ex- 
amples in the above embodiments, it is apparent that 
the present invention is not limited thereto but may be 
used for other recording media. 
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[0096] The above method achieves the first object of 
the present invention. That is, without increasing the da- 
ta size of management information, the user can search 
a huge number of still pictures recorded on a large-ca- 
pacity optical disc medium for a desired still picture us- 
ing its recording time (RECTM). 
[0097] An embodiment of the present invention that 
achieves the second object will be described with refer- 
ence to the attached drawings. 
[0098] Referring to FIG. 11 which shows the configu- 
ration of the embodiment of the present invention, the 
following describes how the recording sequence and the 
attributes of still pictures are recorded in the manage- 
ment information. In the figure, N (an integer equal to or 
larger than 1) still pictures (VOB) 101 coded, for exam- 
ple, in the I picture compression method of MPEG are 
grouped into one still picture group (VOBG) 102. Group 
generation is controlled so that the next still picture 
group (VOBG) 1 02 is generated when the number of still 
pictures (VOB) 1 01 of the still picture group (VOBG) 1 02 
reaches a predetermined value (for example, 64) during 
still picture recording or when the operation mode is 
switched from video recording mode to still picture re- 
cording mode. Data (coded stream data) of the still pic- 
tures (VOB) 1 01 is recorded on a storage medium as a 
VOB file 1013 which will be described later, while infor- 
mation used to define the still picture groups (VOBG) 
1 02 is recorded on the storage medium as a VOB man- 
agement file 1014. 

[0099] The VOB management file 1014 comprises 
management information (VOBGI) 103 corresponding 
to each still picture group (VOBG) 1 02. That is, each still 
picture group (VOBG) 102 has its own management in- 
formation (VOBGI) 103 in this file. Note that information 
used to manage M (an integer equal to or larger than 1 ) 
pieces of management information (VOBGI) 103 may 
be provided separately in the VOB management file 
1014. This information is not shown in the figure be- 
cause it is not related directly to the present invention. 
The management information (VOBGI) 103 comprises 
still picture group identification information (VOBGJD) 
104, still picture group address information 
(VOBG_Address) 105, n urn be r-of-sti II -pictures informa- 
tion (VOBLNumber) 106, and a still picture manage- 
ment information table (VOBLTable) 107. Each entry 
will be described below. 

[0100] The still picture group identification information 
(VOBGJD) 104, a unique value in the VOB manage- 
ment file 1014, identifies each piece of management in- 
formation (VOBGI) 103 and the corresponding still pic- 
ture group (VOBG) 102. Serial numbers beginning with 
the start of the VOB management file 1014 may be used 
for this information, in which case the still picture group 
identification information (VOBGJD) 104 may be omit- 
ted. 

[0101] The still picture group address information 
(VOBG_Address) 105 indicates the start address of 
coded stream data of the still picture group (VOBG) 1 02 



within the VOB file. The information may also contain 
the end address. 

[0102] The number-of -still-pictures information 
(VOBLNumber) 106 indicates the number of still pic- 
5 tures (VOB) 1 01 of the still picture group (VOBG) 1 02. 
[0103] The still picture management information table 
(VOBLTable) 1 07 is composed of still picture manage- 
ment information (VOBI) 108 entries of the still pictures 
(VOB) 101 of the still picture group (VOBG) 102. The 
still picture management information (VOBI) 108 entries 
are stored in the still picture management information 
table (VOBLTable) 1 07 in the sequence in which the 
still pictures (VOB) 101 are stored. For example, still pic- 
ture management information (VOBI) 108-1 shown in 
FIG. 11 corresponds to the still picture (VOB) 101-1. 
[01 04] The still picture management information (VO- 
BI) 1 08 is classified into one of the following according 
to the attribute of the corresponding still picture (VOB) 
101 : management information on a still picture with no 
audio (hereinafter called audio) to be played back in syn- 
chronization with the still picture (first still picture man- 
agement information (VJ)) 109, management informa- 
tion on a still picture with only audio (hereinafter called 
original audio) recorded almost at the same time the still 
picture is recorded (second still picture management in- 
formation (V_OAJ)) 1010, management information on 
a still picture with only added (post-recorded) audio 
(hereinafter post-recorded audio)(third still picture man- 
agement information (V_AA_I)) 1011 , and management 
information on a still picture with both original audio and 
post-recorded audio (fourth still picture management in- 
formation (V_OA_AAJ)) 1 01 2. 
[01 05] The still picture management information table 
(VOBLTable) 107, with this configuration, may hold the 
recording sequence and the attributes of the still pic- 
tures (VOB) 1 01 in the still picture group management 
information (VOBGI) 103. When the still picture (VOB) 
101 is deleted, the corresponding still picture manage- 
ment information ( VOBI) 1 08 is also deleted at the same 
time. 

[0106] Next, referring to FIG. 14, the detailed config- 
uration of the still picture management information (VO- 
BI) 108 will be described. How to reduce the data size 
of management information will also be described. 
[0107] FIG. 14, (a) shows the configuration of man- 
agement information on a still picture with no audio (first 
still picture management information (VJ)) 1 09. VJ 1 09 
is composed of identification information (VJ JD) 1 033, 
which is still picture identification information (VOBI JD) 
identifying the first still picture management information, 
and an picture data size (V_Size) 1034. This data con- 
figuration, necessary and sufficient for playing back a 
still picture with no audio, eliminates redundant parts to 
minimize the management information data size. How 
to get the address of the video part (V_Part) will be de- 
scribed later. 

[0108] FIG. 14, (b) shows the configuration of man- 
agement information on a still picture with only original 
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audio (second still picture management information 
(V_OA_l)) 1010. V_OA_l 1010 is composed of identifi- 
cation information (V_OA_l_ID) 1035, which is still pic- 
ture identification information (VOBIJD) identifying the 
second still picture management information, an picture 
data size (V_Size) 1036, an original audio data size 
(OA_Size) 1037, and an original audio playback time 
(OA_PTM) 1038. This data configuration, necessary 
and sufficient for playing back a still picture with only 
original audio, eliminates redundant parts to minimize 
the management information data size. How to get the 
addresses of the video part (V_Part) and the original au- 
dio part (OA_Part) will be described later. 
[0109] FIG. 14, (c) shows the configuration of man- 
agement information on a still picture with only post-re- 
corded audio (third still picture management information 
(V_AA_I)) 1011. V_AAJ 1011 is composed of identifi- 
cation information (V_AAJJD) 1039, which is still pic- 
ture identification information (VOBIJD) identifying the 
third still picture management information, an picture 
data size (V_Size) 1040, and a post-recorded audio 
pointe^nformation (AAJ_PTR) 1041 which will be de- 
scribecnater. This data configuration, necessary and 
sufficient for playing back a still picture with only post- 
recorded audio, eliminates redundant parts to minimize 
the management information data size. How to get the 
addresses of the video part (V_Part) and the post-re- 
corded audio part (AA^Part) will be described later. 
[0110] FIG. 14, (d) shows the configuration of man- 
agement information on a still picture with both original 
audio and post-recorded audio (fourth still picture man- 
agement information (V_OA_AA_l)) 1012. V_OA_AAJ 
1012 is composed of identification information 
(V_OA_AA_l_ID) 1042, which is still picture identifica- 
tion information (VOBIJD) identifying the fourth still pic- 
ture management information, an picture data size 
(V_Size) 1043, an original audio data size (OA_Size) 
1044, an original audio playback time (OA_PTM) 1045, 
and post-recorded audio pointer information 
(AAJ_PTR) 1 046 which will be described later. This da- 
ta configuration, necessary and sufficient for playing 
back a still picture with both original audio and post-re- 
corded audio, eliminates redundant parts to minimize 
the management information data size. How to get the 
addresses of the video part (V_Part), the original audio 
part (OA_Part), and the post-recorded audio part 
(AA_Part) will be described later. 
[0111] FIG. 14, (e) shows the detailed configuration 
of the still picture identification information (VOBIJD) 
1 047 described above. The still picture identification in- 
formation (VOBIJD) 1047 is composed of TY (Type) 
identifying one of VJJD 1033, VJDAJJD 1035, 
V_AAJJD 1039, and V_OA_AAJJD 1042 and PP 
(Playback Permission) indicating whether or not the still 
picture (VOB) 101 corresponding to the still picture iden- 
tification information (VOBIJD) 1047 is to be played 
back. The PP is a flag wherein "0" indicates that the still 
picture will be played back normally and "1" indicates 



that the still picture cannot be played back. The function 
of this flag is the same as that described in European 
Patent Application No. 99304691 .1 or the correspond- 
ing U.S. Patent Application No. 09/332,882 described 
s above. 

[0112] Classifying the still picture attributes into four 
types as shown in (a) to (d) of FIG. 1 4 and then, for each 
of them, providing still picture management information 
(VOBI) 108 of the necessary and sufficient data size 

10 minimize the data size of the VOB management file 
1014. For example, when four types of still pictures, that 
is, (a) still picture with no audio, (b) still picture with only 
original audio, (c) still picture with only post-recorded 
audio, and (d) still picture with both original audio and 

15 post-recorded audio, are recorded, the total data size of 
the picture management information (V_l) 1 01 7 and the 
audio management information (AJ) 1 020 is 2 bytes for 
(a), 11 bytes for (b), 11 bytes for (c), and 20 bytes for 
(d), respectively. In contrast, when the method shown in 

20 FIG. 14 is used, the data size of the still picture man- 
agement information (VOBI) 108 is 2 bytes for (a), 6 
bytes for (b), 4 bytes for (c), and 8 bytes for (d). For (c) 
and (d), the management information on the post-re- 
corded audio part (AA_Part) is required separately. This 

25 will be described later. 

[0113] In addition, the still picture identification infor- 
mation (VOBIJD) 1047 placed at the start of each of 
stili picture management information (VOBI) 1 08 entries 
gives us information on the data size of the still picture 

30 management information (VOBI) 1 08. For example, the 
TY value of "00", if stored in the still picture identification 
information (VOBI JD) 1 047, indicates that the VOBIJD 
(1 047) is VJ 1 09 and that the total data size is 2 bytes. 
Therefore, the recording position of VOBI #3(108-3) in 

35 the still picture management information table 
(VOBLTable) 107 shown in FIG. 11 may be calculated 
by finding the recording position of VOBI #2(1 08-2) from 
the data size in VOBI #1 (108-1) and then finding the re- 
cording position of VOBI #3(108-3) from the data size 

40 of VOBI #2(108-2). 

[0114] FIG. 15, (a) shows an example of file structure 
used in the embodiment of the present invention. On re- 
cording media such as a DVD-RAM, coded stream data 
such as still pictures, management information, and so 

45 on are recorded as logical files. A storage medium, with 
a directory structure beginning at the root directory 
1048, usually has the above-described VOB file 1013 
and VOB management file 1014 generated and stored 
in a sub-directory 1049. Note that, instead of using the 

50 sub-directory 1049, the VOB file 1013 and the VOB 
management file 1014 may be recorded directly below 
the root directory 1 048. The VOB file 1 01 3 and the VOB 
management file 1014 may also be stored in another 
sub-directory which is below the sub-directory 1049. 

55 [0115] Referring to FIG. 15, (b) in which an example 
of the VOB file 1013 is shown, how to get addresses 
from the data size information shown in FIG. 14 will be 
described. Within one still picture group (VOBG) 102, 
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only the picture part (V_Part) and the original audio part 
(OA_Part) of the still picture (VOB) 101 are recorded 
continuously in the VOB file 1 01 3 as shown in the figure. 
In other words, when other types of data such as video 
data must be recorded in the VOB file 1013, another still 5 
picture group (VOBG) 102 will be generated as de- 
scribed above. The figure shows an example of the con- 
tents of a VOB file. It contains the picture part (V_Part 
#1) 1050 of still picture #1(VOB #1), the picture part 
(V_Part #2) 1 051 of still picture #2(VOB #2) and its orig- 10 
inal audio part (OA_Part #2) 1052 recorded almost at 
the same time, the picture part (V_Part #3) 1053 of still 
picture #3(VOB #3), the picture part (V_Part #4) 1054 
of still picture #4(VOB #4) and its original audio part 
(OA_Part #4) 1 055 recorded almost at the same time. 15 
In this case, for example, the start address of the picture 
part (V_Part #3) 1053 of still picture #3(VOB #3) is cal- 
culated by adding up the data size (V_Size #1 ) of V_Part 
#1 (1 050), the data size (V_Size #2) of V_Part #2(1 051 ), 
and the data size (OA_Size #2) of OA_Part #2(1052) 20 
and then adding to the result the start address of V_Part 
#1(1050) recorded in the still picture group address in- 
formation (VOBG_Address) 1 05. Adding up data sizes 
to get an address like this eliminates the need to update 
the contents of the management information of the fol- 25 
lowing still picture #4(VOB #4) even when the still pic- 
ture #3(VOB #3) is deleted. Therefore, this configuration 
significantly reduces the time needed to reconfigure the 
management information. 

[0116] Since post-recorded audio parts (AA_Part) are 30 
added independently of the sequence in which the pic- 
ture parts (V_Part) are recorded and because, in com- 
parison with picture parts (V_Part) and original audio 
parts (OA_Part), there are farfewer post-recorded audio 
parts, the post-recorded audio parts (AA_Part) are con- 35 
figured separately from V_Part and OA_Part. For exam- 
ple, the audio management information (A_l) 1020 is 
provided in the audio management information table 
(A_l_Table) 1019 shown in FIG. 12 and, in that table, 
the address information (A_Address) 1023, audio data 40 
size (A_Size) 1024, and audio playback time (A_PTM) 

1 025 of the post-recorded audio part (AA_Part) are re- 
corded. Storing a pointer to the number (such as #1) of 
the audio management information (A_l) 1020 in the 
post-recorded audio pointer information (AAJ_PTR) 45 
1041 , 1046 shown in FIG. 14 allows the address, data 
size, and playback time of the post-recorded audio part 
(AA_Part) corresponding to the still picture manage- 
ment information (VOBI) to be obtained. Also, because 

the number of post-recorded audio entries is limited to so 
one, there is no need to provide the audio pointer infor- 
mation (A_I_PTR) 1026 to link to other audio data. This 
means that the audio pointer information (AJ_PTR) 

1026 may be omitted. 

[0117] In addition, the data configuration composed 55 
only of post-recorded audio parts (AA_Part) allows an 
address to be calculated by adding up the audio data 
sizes (A_Size) 1024 beginning at the start. This means 



that the audio data address information (A_Address) 
(1 023) may be omitted. 

[0118] FIG. 16 is a diagram showing the configuration 
of an embodiment of the recording/playback apparatus 
according to the present invention. The recording/play- 
back apparatus may be a special hardware unit or a gen- 
eral-purpose hardware unit such as a personal compu- 
ter controlled by a control procedure (hereinafter called 
a program) which will be described later. In either case, 
a system controller 1056 performs operation according 
to the program stored in memory 10101. The memory 
10101 where the program is stored may be the same 
storage medium as is used as memory 1 01 02 where the 
management information is recorded. Or, they may be 
separately configured. For example, a storage medium 
for rarely-rewritten data, such as a read-only memory 
(ROM) or flash memory, is used for the memory 10101, 
while a storage medjum for frequently-rewritten data, 
such as a Dynamic Random Access Memory (DRAM) 
or a Static Random Access Memory (SRAM), is used 
for the memory 10102. The contents of the memory 
10101 where the program is stored may be preset by 
the manufacturer before shipping or, as shown in FIG. 
20, the program may be read from another storage me- 
dium (computer-readable storage medium) before the 
apparatus starts operation. 

[0119] FIG. 20 shows an example of the recording/ 
playback apparatus configured according to the present 
invention. Referring to the figure, the recording/play- 
back apparatus comprises a computer system unit 
101003, a monitor 101001 on which pictures are dis- 
played, speakers 1 01 002 from which sounds are output, 
a mouse 1 01 004 and a keyboard 1 01 005 which receive 
user's instructions, and a disk drive 101006 which 
records data to, or plays back data from, a storage me- 
dium 1 01 007. The storage medium 1 01 007 stores ther- 
eon the program controlling the computer system unit 
1 01 003, and the program is read (installed) into memory 
10101 of the computer via the drive 1 01 006 before the 
computer is used as a recording/playback apparatus. 
The storage medium 101007 is a read-only disc, such 
as a CD-ROM or DVD-ROM, or a floppy disk. In addition, 
a rewritable medium such as a DVD-RAM may be used 
as the storage medium 1 01 007 to allow the program and 
the picture/audio data to be mixed on the same medium. 
[0120] FIG. 16 is a diagram showing the configuration 
of an embodiment of the recording/playback apparatus 
according to the present invention. When a user inter- 
face 1 057 of the recording/playback apparatus receives 
an operation instruction from the user, a system control- 
ler 1056 starts operation control of the parts which will 
be described later. At recording time, an input unit 1058 
receives the picture signals and audio signals, and an 
encoder 1059 codes the signals using the MPEG sys- 
tem. Coded data such as video, still picture, and audio 
data is entered into a drive 1 061 via a track buffer 1 060 
for recording onto a storage medium 1062. At this time, 
the management information generated by the system 



11 



21 



EP 1 204 269 A1 



22 



controller 1056 according to the method shown in FIGs. 
1 1 and 1 4 is also recorded. While coded data is recorded 
in real time, it is difficult to record management informa- 
tion at the same time. Therefore, recording of the man- 
agement information is controlled so that it is once re- 
corded in the memory 1 01 02 and then written onto the 
storage medium 1 062 after the coded data is recorded. 
Reducing the size of the memory 10102 is one of the 
objects of the present invention. 
[0121] On the other hand, at playback time, the drive 
1061 reads the management information from the stor- 
age medium 1 062 into memory 1 01 02 and, then, based 
on the management information that was read, reads 
coded data into the track buffer 1 060. A decoder 1 063 
decodes the coded data sent from the track buffer 1 060, 
and an output unit 1064 outputs the decoded data. Be- 
cause the detailed operation of the above units is dis- 
closed, for example, in European Patent Application No. 
99304691.1 or corresponding U.S. Patent Application 
No. 09/332,882 and its detailed configuration is known, 
they ara not shown here. The following describes the 
record'Jg method and the playback method according 
to the present invention , with emphasis on the operation 
of the system controller 1 056 (that is, the contents of the 
program). 

[0122] FIG. 17 shows an example of the original re- 
cording method according to the present invention. Re- 
cording starts in step 1065. In step 1066, the still picture 
group (VOBG) 102 to which a still picture (VOB) 101 is 
to belong and the corresponding still picture group man- 
agement information (VOBGI) 103 are determined. 
Then, control goes to step 1 067. At this time, if another 
still picture (VOB) 101 was recorded immediately be- 
fore, the still picture group (VOBG) 1 02 and the still pic- 
ture group management information (VOBGI) 1 03 used 
in recording immediately preceding still picture (VOB) 
101 may be used. If the number of still pictures in the 
still picture group (VOBG) 102 has reached a predeter- 
mined number (for example, 64) or if other types of data 
such as video data was recorded immediately before, a 
new still picture group (VOBG) 102 and still picture 
group management information (VOBGI) 103 may be 
generated. 

[0123] In step 1067, the coded stream data of the pic- 
ture part (V_Part) of the still picture (VOB) 1 01 is record- 
ed on the storage medium 1062 as the VOB file 1013. 
Control goes to step 1 068. 

[01 24] In step 1 068, a check is made to see if the orig- 
inal audio is to be recorded. If it is not to be recorded, 
control goes to step 1 069; if it is to be recorded, control 
goes to step 1 070. For this checking, the user may de- 
cide, before the still picture is recorded, the operation 
mode indicating whether the original audio is to be re- 
corded. With this user-decided state stored in the mode 
switch or in the mode memory provided in the recording 
apparatus, whether or not the original audio is to be re- 
corded may be determined according to the stored 
state. 



[0125] In step 1 069, the management information on 
a still picture with no audio (first still picture management 
information (V_l)) 1 09 is added to the end of the still pic- 
ture management information table (VOBLTable) 107 

5 within the still picture group management information 
(VOBGI) 103 shown in FIG. 11. Then, the identification 
information (VJJD) identifying that the information is 
the first still picture information and picture data size 
(V_Size) 1 034 are recorded in the (first still picture man- 

10 agement information (VJ)) 109 as shown in FIG. 14. 
Control then goes to step 1072. 
[01 26] In step 1 070, the coded stream data of the orig- 
inal audio part (OA_Part) to be played back in synchro- 
nization with the still picture (VOB) 101 is added to the 

15 VOB file 1013, and control is passed to step 1071. 
[0127] In step 1071 , the management information on 
a still picture with only original audio (second still picture 
management information (V_OAJ)) 1010 is added to 
the end of the still picture management information table 

20 (VOBLTable) 1 07 within the still picture group manage- 
ment information (VOBGI) 103. Then, the identification 
information (V_OA_l_ID) identifying that the manage- 
ment information is the second still picture management 
information, the picture data size (V_Size) 1036, the 

25 original audio data size (OA_Size) 1 037, and the original 
audio playback time (OA_PTM) 1 038 are recorded in 
the (V_OAJ) 1010 as shown in FIG. 14. Control then 
goes to step 1072. 

[0128] In step 1072, the original recording operation 
30 ends. 

[0129] FIG. 1 8 shows an example of the post-record- 
ing method used in the present invention. Recording 
starts in step 1073. In step 1074, the user selects the 
still picture (VOB) 101 for which audio is to be post-re- 

35 corded. At the same time, the system controller (1 056) 
of the recording unit determines the still picture group 
(VOBG) 1 02 to which the still picture (VOB) 1 01 belongs 
as well as the corresponding still picture group manage- 
ment information (VOBGI) 1 03 and still picture manage- 

40 ment information (VOBI) 1 08. Then, control goes to step 
1075. 

[01 30] In step 1 075, a check is made for the still pic- 
ture management information (VOBI) 108 selected in 
step 1074 to determine the type (VJ(109), V_OAJ 

45 (1010), V_AAJ(1011), or VOA_AA_I(1012)) by refer- 
ring to the VOBIJD(1 047) shown in FIG. 1 4. Then, con- 
trol is passed to step 1 076 if the type is V_l(1 09), to step 
1 077 if the type is V_OAJ(1 01 0), or to step 1 078 if the 
type is V_AA_I(1011) or V_OA_AAJ(1012). 

50 [0131] In step 1 076, V_l(1 09) is changed to V_AA_I 
(1011) and control is passed to step 1079. That is, as 
shown in FIG. 14, the value of TY in (VOBIJD) 1047 is 
changed from "00" to "10" and, at the same time, the 
management information following the VOBI JD(1 047) 

55 is shifted two bytes in memory to vacate a two-byte area 
for storing the post-recorded audio pointer information 
(AA_LPTR) 1041. 

[0132] In step 1077, V_OAJ(1010) is changed to 
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V_OA_AA_I(1012) and control is passed to step 1079. 
That is, the value of TY in (VOBIJD) 1047 is changed 
from "01 " to "1 1 " and, at the same time, the management 
information following the VOBI_ID(1047) is shifted two 
bytes in memory to vacate a two-byte area for storing 
the post-recorded audio pointer information 
(AA_I_PTR)1046. 

[0133] In step 1078, the post-recorded audio part 
(AA_Part) corresponding to this still picture is located 
using AAJ_PTR(1041) recorded in V_AA_I(1011) or 
using AAJ_PTR(1 046) recorded in V_OA_AAJ(1012) 
and is deleted. Control goes to step 1079. 
[0134] In step 1079, the coded stream data of the 
post-recorded audio part (AA_Part) is recorded on the 
storage medium 1062. Control goes to step 1080. 
[0135] In step 1080, the post-recorded audio pointer 
information AAJ__PTR(1041 or 1046) providing a link to 
the post-recorded audio part (AA_Part) recorded in step 
1079 is set in the VOBI_ID(1047). In step 1081, post- 
recording of audio data ends. 

[0136] FIG. 1 9 shows an example of playing back still 
pictures according to the present invention. Playing 
back starts in step 1082. in step 1083, the still picture 
group (VOBG) 102 to be played back and the corre- 
sponding still picture group management information 
(VOBGI) 1 03 are determined. Then , control goes to step 
1084. At this time, the user may directly select the still 
picture group (VOBG) 102 to be played back. Or, the 
still picture group management information (VOBGI) 
103 may be selected sequentially according to the se- 
quence in which still picture groups (VOBG) 102 were 
( actually recorded, according to the sequence in which 
the still picture group management information (VOBGI) 
103 is recorded in the VOB management file 1014, or 
according to a user-specified predetermined playback 
sequence. Note that the user-specified playback se- 
quence is recorded in Celll in PGCI In the PGCI table 
described in European Patent Application No. 
99304691.1 or corresponding U.S. Patent Application 
No. 09/332,882. 

[0137] In step 1084, the still picture (VOB) 101 is 
played back according to the sequence in which the still 
picture management information (VOBI) 108 entries are 
recorded in the still picture management information ta- 
ble (VOBI_Table) 1 07 in the still picture group manage- 
ment information (VOBGI) 1 03. The procedure is shown 
in steps 1085 to 1092. 

[0138] In step 1085, the still picture management in- 
formation (VOBI) 108 corresponding to the still picture 
(VOB) 101 to be displayed first is selected for process- 
ing, and control is passed to step 1 086. At this time, the 
first VOBI 108 in VOBLTable 107 (VOBI #1(108-1) in 
FIG. 11) or a user specified VOBM08 may be proc- 
essed. Note that the user-specified VOBI 108 may be 
recorded in Cell_Start_Video in Celll described in Euro- 
pean Patent Application No. 99304691 .1 or correspond- 
ing U.S. Patent Application No. 09/332,882. 
[0139] Instep 1086, the V-Sizes 1034, 1036, 1040, or 



1 043 and OA_Sizes 1 037 or 1044 recorded in the VOBI 
1 08 entries from the first (VOBI) 1 08 in the VOBLTable 

107 to the VOBI 108 immediately preceding the VOBI 

108 to be processed are added up. The resulting value 
5 is added to the start address stored in the still picture 

group address information (VOBG_Address) 1 05 to find 
the address of the desired picture part (V_Part). Next, 
the data size of the V_Part is obtained from the V_Size 
1034, 1036, 1040, or 1043 recorded in the VOBI 108 

10 determined in step 1085, and the V_Part is read from 
the storage medium 1062. The decoder 1063 decodes 
the picture data, and the output unit 1 064 plays back the 
picture. Control goes to step 1087. 
[01 40] In step 1 087, a check is made for the VOB1 1 08 

15 to be processed to determine the type (VJ(109), 
V_OA_I(1010), V_AAJ(1011), or V_OA_AAJ(1012)) 
by referring to the (VOBIJD) 1047. Then, control is 
passed to step 1 091 if the type is VJ 1 09, to step 1 088 
if the type is V_OA_I(1010), to step 1089 if the type is 

20 V_AA_I(1011), or to step 1090 if the type is V_OA_AA_l 
(1012). 

[0141] In step 1 088, the data size of the original audio 
part (OA_Part) is obtained from the OA_Size 1037 re- 
corded in the V_OA_l(1 010) and, at the same time, the 

25 data size of the V_Part is added to the address of the 
V_Part obtained in step 1086 to find the address of the 
OA_Part. The OA_Part is read from the storage medium 
1062. The decoder 1063 decodes the audio data, and 
the output unit 1 064 plays back the audio. Control goes 

30 to step 1091. 

[0142] In step 1089, the post-recorded audio part 
(AA_Part) corresponding to the still picture is located us- 
ing the AAJ_PTR 1041 recorded in the V_AAJ 1011. 
The post-recorded audio part (AA_Part) is read from the 

35 storage medium 1062. The decoder 1063 decodes the 
audio data, and the output unit 1064 plays back the au- 
dio. Control goes to step 1091 . 
[0143] In step 1090, which audio part, either original 
audio part (OA_Part) or post-recorded audio part 

40 (AA_Part), is to be played back is determined according 
to the user's selection. When the OA_Part is to be 
played back, the OA_Part is read for playback using the 
OA_Size 1044 recorded in the V_OA_AAJ 1012 ac- 
cording to the procedure used in step 1088. When the 

45 AA_Part is to be played back, the AA_Part is read for 
playback using the AA_I_PTR 1046 recorded in the 
V_OA_AA_I(1012) according to the procedure used in 
step 1089. Control goes to step 1091 . 
[0144] In step 1 091 , a check is made to see if the VO- 

50 Bl 108 being processed is the last VOBI. If so, control 
goes to step 1093; if not, control goes to step 1092. At 
this time, the last VOBI may be the last VOB1 1 08 (VOBI 
#5(108-5) in FIG. 11) recorded in the VOBLTable 107 
or a user-specified VOB1 1 08. Note that a user specified 

55 VOBI 108 may be recorded in CelLEnd_Video in Cell 
described in European Patent Application No. 
99304691.1 or corresponding U.S. Patent Application 
No. 09/332,882. 
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[0145] In step 1092, the next VOBI 108 in the 
VOBI_Table 107 is selected for processing and control 
goes back to step 1 086. 

[0146] In step 1093, the playback operation ends. 
[0147] The above operation enables still pictures 5 
(VOB) 1 01 to be played back according to the sequence 
in which the still picture management information (VO- 
BI) 108 entries are recorded in the still picture manage- 
ment information table (VOBI_Table) 107. 
[0148] Although only DVD-RAM and DVD-R discs are 10 
used as examples in the above embodiment, it is appar- 
ent that the present invention is not limited thereto but 
may be used for other recording media. While the data 
sizes of the parts (101 byte and so on) are shown in FIG. 
14, they are for illustrative purposes only and the *5 
present invention is not limited to these sizes. 
[0149] The method described above achieves the 
second object of the present invention. That is, the 
method records a huge number of still picture data piec- 
es and audio data to be played back in synchronization 20 
with the still picture data onto a large-capacity optical 
disc milium. Even when some still pictures are deleted, 
the rriefhod significantly reduces the time needed to 
reconfigure management information and the data size 
of the management information. 25 
[0150] By way of additional definitions of the subject 
matter of this application we refer to the following claus- 
es: 

1. A storage medium recording still picture data 30 
(VOB) (1 ) thereon, said storage medium comprising 

still picture group management information (VOB- 
Gl) (3) for managing N (N is an integer equal to or 
larger than 1 .) pieces of still picture data (VOB) (1) 
as a still picture group (VOBG) (2), said still picture 35 
group management information (VOBGI) (3) com- 
prising a recording time (F_RECTM) (7) of the still 
picture data (VOB) (1) recorded first, and the re- 
cording time (L_RECTM) (8) of the still picture 
(VOB) (1) recorded last, in the still picture group 40 
(VOBG) (2).. 

2. A storage medium recording still picture data 
(VOB) (1 ) thereon, said storage medium comprising 
still picture group management information (VOB- 
GI) (3) for managing N (N is an integer equal to or *s 
larger than 1 .) pieces of still picture data (VOB) (1) 

as a still picture group (VOBG) (2) and still picture 
recording time management information (RECTMI) 
(22) for managing a recording time (RECTM) of 
each of said still pictures (VOB) (1), said still picture 50 
group management information (VOBGI) (3) com- 
prising pointer information (RECTMLP) (21) point- 
ing to said still picture recording time management 
information (RECTMI) (22). 

3. A storage medium recording still picture data 55 
(VOB) (1 ) thereon, said storage medium comprising 
thumbnail picture data (THM) (28) corresponding to 

the still picture data (VOB) (1) and thumbnail man- 



agement information (THMI) (29) for managing the 
thumbnail picture data (THM) (28), said thumbnail 
management information (THMI) (29) comprising 
still picture recording time management information 
(RECTMI) (22) for managing a recording time 
(RECTM) of each of said still pictures (VOB) (1). 

4. A storage medium recording still picture data 
(VOB) (1 ) thereon, said storage medium comprising 
thumbnail picture data (THM) (28) corresponding to 
said still picture data (VOB) (1 ) and thumbnail group 
management information (THMGI) (34) for manag- 
ing a plurality pieces of thumbnail picture data 
(THM) (28) as a thumbnail group (THMG) (40). 

5. The storage medium according to clause 4, fur- 
ther comprising still picture group management in- 
formation (VOBGI) (3) for managing N (N is an in- 
teger equal to or largerthan 1 .) pieces of still picture 
data (VOB) (1) as a still picture group (VOBG) (2) 
and thumbnail groups associating therewith a 
grouping unit synchronizing with said still picture 
groups (VOBG) (2). 

6. A recording apparatus for recording the still pic- 
ture data (VOB) (1 ) on the storage medium accord- 
ing to clause 1, wherein said recording apparatus 
compares a time (RECTM) at which the still picture 
data (VOB) (1 ) was recorded with the first recording 
time (F_RECTM) (7) stored in the still picture group 
management information (VOBGI) (3) correspond- 
ing to the still picture group (VOBG) (2) to which the 
still picture data (VOB) (1) belongs and, if RECTM 
is earlier than F_RECTM (RECTM < F.RECTM), 
replaces contents of F_RECTM with the contents 
of RECTM before recording. 

7. A recording apparatus for recording the still pic- 
ture data (VOB) (1 ) on the storage medium accord- 
ing to clause 1 , wherein said recording apparatus 
compares a time (RECTM) at which the still picture 
data (VOB) (1 ) was recorded with the last recording 
time (L_RECTM) (8) stored in the still picture group 
management information (VOBGI) (3) correspond- 
ing to the still picture group (VOBG) (2) to which the 
still picture data (VOB) (1) belongs and, if RECTM 
is later than L.RECTM (RECTM > L_RECTM), re- 
places contents of L_RECTM with the contents of 
RECTM before recording. 

8. A playback apparatus for playing back the stor- 
age medium according to clause 1 , said playback 
apparatus comprising a user interface (42) for re- 
ceiving a desired time (TM), a system controller (41 ) 
for comparing the time (TM) with the first recording 
time (F_ RECTM) (7) and with the last recording 
time (L_RECTM) (8) for each still picture group 
(VOBG) (2), and means (46) for reading the still pic- 
ture data (VOB) (1) from the storage medium (47) 
for playback, wherein said playback apparatus se- 
lectively displays only the still pictures (VOB) (1) be- 
longing to the still picture group (VOBG) (2) satisfy- 
ing a relation in which TM is equal to or later than F 
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RECTM and equal to or earlier than L RECTM 
(F_RECTM<TM<L_RECTM). 

9. The storage medium according to 1 , wherein the 
storage medium is an optical disc. 

10. A computer-readable storage medium storing 5 
thereon a procedure for causing a computer to 
record still picture data and still picture data man- 
agement information, said still picture data man- 
agement information comprising still picture group 
management information (VOBGI) (3) for managing 10 
N (N is an integer equal to or larger than 1 .) pieces 

of still picture data (VOB) (1) as a still picture group 
(VOBG) (2), said still picture group management in- 
formation (VOBGI) (3) comprising a recording time 
(F_RECTM) (7) of the still picture data (VOB) (1) 15 
recorded first, and the recording time (L_RECTM) 
(8) of the still picture (VOB) (1 ) recorded last, in the 
still picture group (VOBG) (2). 

11. A storage medium having still picture data 
(VOB) (101) recorded thereon, comprising: 20 

still picture group management information 
(VOBGI) (103) for managing N (where, N is an 
integer equal to or larger than 1) pieces of still 
picture data (VOB) (1 01 ) as a still picture group 25 
(VOBG) (1 02), said still picture group manage- 
ment information (VOBGI) (103) comprising a 
still picture management information table 
(VOBLTable) (107), said still picture manage- 
ment information table (VOBLTable) (107) 30 
comprising still picture management informa- 
tion (VOBI) (1 08) classified into one of manage- 
ment information on a still picture with no audio 
to be played back in synchronization with the 
still picture (hereinafter called audio) (hereinaf- 35 
ter called first still picture management informa- 
tion (VJ) (109)), the management information 
on the still picture with only audio recorded al- 
most at the same time the still picture is record- 
ed (hereinafter called original audio) (hereinaf- 40 
ter called second still picture management in- 
formation (V_OA_l) (1010)), the management 
information on the still picture with only added 
(post-recorded) audio (hereinafter called post- 
recorded audio) (hereinafter called third still 45 
picture management information (V_AA_l) 
(1011)), and the management information on 
the still picture with both the original audio and 
the post-recorded audio (hereinafter called 
fourth still picture management information 50 
(V_OA_AAJ) (1012)), wherein a sequence in 
which the still picture management information 
(VOBI) (1 08) is stored in said still picture man- 
agement information table (VOBLTable) (107) 
is the sequence in which the still pictures 55 
(VOBs) are recorded. 

12. The storage medium according to clause 11, 



wherein said first still picture management informa- 
tion (VJ) (109) comprises identification information 
(VJJD) (1023) identifying the first still picture man- 
agement information and size information (V_Size) 
(1 034) on the picture data (V-Part) of the still picture 
(VOB) (101) corresponding to the management in- 
formation. 

13. The storage medium according to clause 11, 
wherein said second still picture management infor- 
mation (V_OAJ) (1010) comprises identification in- 
formation (V_OA_l_ID) (1035) identifying the sec- 
ond still picture management information (V_OA_l) 
(1 01 0), size information (V_Size) (1 036) on the pic- 
ture data (V_Part) of the still picture (VOB) (101) 
corresponding to the management information, the 
size information (OA_Size) (1037) on the original 
audio data (OA_Part) of the still picture (VOB) (1 01) 
corresponding to the management information, and 
a playback time (OA_PTM) (1038) of the original 
audio data (OA_part). 

14. The storage medium according to clause 11, 
wherein said third still picture management informa- 
tion (V_AA_I) (1011) comprises identification infor- 
mation (V_AAJJD) (1039) identifying the third still 
picture management information (V_AA_I) (1011), 
size information (V_Size) (1 040) on the picture data 
(V Part) of the still picture (VOB) (101) correspond- 
ing to the management information, and pointer in- 
formation (AAJ_PTR) (1 041 ) providing a link to the 
post-recorded audio data (AA_Part) of the still pic- 
ture (VOB) (101) corresponding to the management 
information. 

15. The storage medium according to clause 11, 
wherein said fourth still picture management infor- 
mation (V_OA_AAJ) (1012) comprises identifica- 
tion information (V jDA_AAJJD) (1042) identifying 
the fourth still picture management information 
(V_OA_AA_l) (1012), size information (V_Size) 
(1043) on picture part (V_part) of the still picture 
(VOB) (101) corresponding to the management in- 
formation, the size information (OA-Size) (1044) on 
the original audio data (OA_part) of the still picture 
(VOB) (101) corresponding to the management in- 
formation, a playback time (OA_PTM) (1045) of the 
original audio data (OA_Part), and pointer informa- 
tion (AA_I_PTR) (1 046) providing a link to the post- 
recorded audio data (AA_part) of the still picture 
(VOB) (101) corresponding to the management in- 
formation. 

16. An optical disc recording apparatus for record- 
ing at least the still picture data (VOB) (101) on the 
storage medium according to clause 11, wherein, 
when recording the still picture data (VOB) (101), 
said optical disc recording apparatus selects said 
first still picture management information (VJ) 
(1 09) when said original audio is not to be recorded, 
or said second still picture management information 
(V_OA_l) (1010) when said original audio is to be 
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recorded, before adding the management informa- 
tion to said still picture management information ta- 
ble (VOBI_Table)(107). 

17. An optical disc recording apparatus for record- 
ing at least the still picture data (VOB) (101) on the 5 
storage medium according to clause 11, wherein, 
when post-recording the audio on the still picture 
data (VOB) (1 01 ) already recorded, said optical disc 
recording apparatus replaces said first still picture 
management information (V_l) (1 09) corresponding 10 
to said stiil picture data (VOB) (101) with said third 
still picture management information (V_AA_I) 
(1011) when the audio is to be post-recorded on 
said still picture without said original audio, or said 
second still picture management information is 
(V_OAJ) (1010) corresponding to said still picture 
data (VOB) (101) with said fourth still picture man- 
agement information (V_OA_AA_l) (1012) when 
the audio is to be post-recorded on said still picture 
having said original audio, before recording the pic- 20 
tu^ management information into said still picture 
miCJagement information table (VOBI_Table) (1 07). 
1 8rA playback apparatus for playing back the stor- 
age medium according to any of clause 11 , wherein 
said playback apparatus plays back said still picture 25 
data (VOB) (101) corresponding to still picture man- 
agement information (VOB!) (108) according to the 
sequence in which said still picture management in- 
formation (VOBI) (108) is recorded in said still pic- 
ture management information table (VOBLTable) 30 
(107). 

19. An storage medium on which picture data 
groups, each composed of one or more picture data 
pieces, and picture data group management infor- 
mation including information for accessing the pic- 35 
ture data in the picture data groups are recorded, 
wherein said picture data management information 

is classified into four types according to whether or 
not the picture data management information con- 
tains information on audio to be played back in syn- 40 
chronization with the corresponding picture data 
and whether or not the picture data management 
information contains the information on the audio 
added to the corresponding picture data for play- 
back in synchronization with the picture data. 45 

20. An storage medium on which picture data is re- 
corded, wherein said storage medium has identifi- 
cation information recorded thereon, said identifica- 
tion information identifying that management infor- 
mation is one of the management information on the so 
picture data with no audio, the management infor- 
mation on the picture data with only the audio re- 
corded almost at the same time the picture data was 
recorded, the management information on the pic- 
ture data with only the audio added to the picture 55 
data already recorded, and the management infor- 
mation on the picture data with the audio recorded 
almost at the same time the picture data was re- 



corded and with the audio added to the picture data 
already recorded. 

21. The storage medium according to clause 20, 
wherein a sequence in which said identification in- 
formation is recorded is the sequence in which the 
picture data is recorded on the storage medium. 

22. An recording apparatus for recording picture da- 
ta and picture data management information on a 
storage medium, wherein said recording apparatus 
classifies the picture data management information 
into the management information on the picture da- 
ta with no audio, the management information on 
the picture data with only the audio recorded almost 
at the same time the picture data was recorded, the 
management information on the picture data with 
only the audio added to the picture data already re- 
corded, and the management information on the 
picture data with the audio recorded almost at the 
same time the picture data was recorded and with 
the audio added to the picture data already record- 
ed, before recording the management information 
on the storage medium. 

23. A method for recording picture data and man- 
agement information on the picture data onto a stor- 
age medium, said method comprising the step of 
recording identification information as part of said 
management information on the picture data, said 
identification information identifying that the man- 
agement information is one of the management in- 
formation on the picture data with no audio, the 
management information on the picture data with 
only the audio recorded almost at the same time the 
picture data was recorded, the management infor- 
mation on the picture data with only the audio added 
to the picture data already recorded, and the man- 
agement information on the picture data with the au- 
dio recorded almost at the same time the picture 
data was recorded and with the audio added to the 
picture data already recorded. 

24. A method for recording picture data and man- 
agement information on the picture data onto a stor- 
age medium, said method comprising the step of 
classifying said management information into the 
management information on the picture data with 
no audio, the management information on the pic- 
ture data with only the audio recorded almost at the 
same time the picture data was recorded, the man- 
agement information on the picture data with only 
the audio added to the picture data already record- 
ed, and the management information on the picture 
data with the audio recorded almost at the same 
time the picture data was recorded and with the au- 
dio added to the picture data already recorded, be- 
fore the management information is recorded. 

25. A computer-readable storage medium storing 
thereon a procedure for causing a computer to 
record still picture data and still picture data man- 
agement information, wherein said procedure clas- 
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sifies the picture data management information into 
the management information on the picture data 
with no audio, the management information on the 
picture data with only the audio recorded almost at 
the same time the picture data was recorded, the 5 
management information on the picture data with 
only the audio added to the picture data already re- 
corded, and the management information on the 
picture data with the audio recorded almost at the 
same time the picture data was recorded and with 
the audio added to the picture data already record- 
ed, before recording the management information 
on the storage medium. 

26. A computer-readable storage medium storing 
thereon a procedure for causing a computer to 
record still picture data and still picture data man- 
agement information, wherein said procedure 
records identification information as part of said 
management information on the picture data, said 
identification information identifying that the man- 
agement information is one of the management in- 
formation on the picture data with no audio, the 
management information on the picture data with 
only the audio recorded almost at the same time the 
picture data was recorded, the management infor- 
mation on the picture data with only the audio added 
to the picture data already recorded, and the man- 
agement information on the picture data with the au- 
dio recorded almost at the same time the picture 
data was recorded and with the audio added to the 
picture data already recorded. 

27. A computer-readable storage medium storing 
thereon a procedure for causing a computer to 
record still picture data apd still picture data man- 
agement information, wherein said procedure clas- 
sifies said picture data management information in- 
to the management information on the picture data 
with no audio, the management information on the 
picture data with only the audio recorded almost at 
the same time the picture data was recorded, the 
management information on the picture data with 
only the audio added to the picture data already re- 
corded, and the management information on the 
picture data with the audio recorded almost at the 
same time the picture data was recorded and with 
the audio added to the picture data already record- 
ed, before the management information is record- 
ed. 



Claims 

1 . A method for recording still picture data (VOB) and 
still picture group management information (VOB- 
Gl) for managing and N still pictures data (VOB) as 
a still picture group (VOBG) onto a storage medium, 
where said N is an integer number equal to or larger 
than one, characterized in that 



said still picture group management informa- 
tion (VOBGI) includes a first recording time 
(F_RECTM) at which the still picture data (VOB) in 
said still picture group (VOBG) was recorded first 
and a last recording time (L_RECTM) at which the 
still picture data (VOB) in said still picture group 
(VOBG) was recorded iast, 

said method comprises the steps of: 

comparing a recording time (RECTM) of said 
still picture data (VOB) with said fist recording 
times (F_RECTM) stored in said still picture 
group management information (VOBGI) cor- 
responding to the still picture group (VOBG) be- 
longing to said still picture data (VOB); and 
if said recording time (RECTM) is earlier 
(RECTM <F_RECTM) than said first recording 
time (F_RECTM), replacing the content of said 
fist recording times (F_RECTM) by said record- 
ing time (RECTM) and recording thereof. 

2. A method according to claim 1, characterized by 
further comprising the steps of: 

comparing a recording time (RECTM) of said 
still picture data (VOB) with said last recording 
times (L_RECTM) stored in said still picture 
group management information (VOBGI) cor- 
responding to the still picture group (VOBG) be- 
longing to said still picture data (VOB); and 
if said recording time (RECTM) is later 
(RECTM> L_ RECTM) than said last recording 
time (L_RECTM), replacing the content of said 
last recording times (L_RECTM) by said re- 
cording time (RECTM) and recording thereof. 

3. An apparatus for recording still picture data (VOB) 
and still picture group management information 
(VOBGI) for managing N still pictures data (VOB) 
as a still picture group (VOBG) onto a storage me- 
dium, where said N is an integer number equal to 
or larger than one, 

characterized In that 

said still picture group management informa- 
tion (VOBGI) includes a first recording time 
(F_RECTM) at which the still picture data (VOB) in 
said still picture group (VOBG) was recorded first 
and a last recording time (L_RECTM) at which the 
still picture data (VOB) in said still picture group 
(VOBG) was recorded last, 

said apparatus comprises: 

means for comparing a recording time 
(RECTM) of said still picture data (VOB) with 
said fist recording times (F_RECTM) stored in 
said still picture group management informa- 
tion (VOBGI) corresponding to the still picture 
group (VOBG) belonging to said still picture da- 
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ta (VOB); and 

means, if said recording time (RECTM) is later 
(RECTM>L_RECTM) than said last recording 
time (L_RECTM), for replacing the content of 
said last recording times (L_RECTM) by said s 
recording time (RECTM) and recording thereof. 

4. An apparatus according to claim 3, characterized 

by further comprising: 

10 

means for comparing a recording time 
(RECTM) of said still picture data (VOB) with 
said last recording times (L_RECTM) stored in 
said still picture group management informa- 
tion (VOBGI) corresponding to the still picture *5 
group (VOBG) belonging to said still picture da- 
ta (VOB); and 

if said recording time (RECTM) is later 
(RECTM> L_RECTM) than said last recording 
time (L_RECTM), the content of said last re- 20 
jg cording times (L_RECTM) is replaced by said 
^recording time (RECTM) and recorded. 

5. A computer-readable storage medium storing ther- 
eon a procedure for controlling a computer to record 25 
still picture data (VOB) and still picture group man- 
agement information (VOBGI) for managing N still 
pictures data (VOB) as a still picture group (VOBG) 
onto a storage medium, where said N is an integer 
number equal to or larger than one, characterized 30 
in that 

said still picture group management informa- 
tion (VOBGI) includes a first recording time 
(F_RECTM) at which the still picture data (VOB) in 
said still picture group (VOBG) was recorded first 35 
and a last recording time (L_RECTM) at which the 
still picture data (VOB) in said still picture group 
(VOBG) was recorded last, 

said procedure comprises the steps of: 

40 

comparing a recording time (RECTM) of said 
still picture data (VOB) with said fist recording 
times (F_RECTM) stored in said still picture 
group management information (VOBGI) cor- 
responding to the still picture group (VOBG) be- 45 
longing to said still picture data (VOB); and 
if said recording time (RECTM) is earlier 
(RECTM <F_RECTM) than said first recording 
time (F_RECTM), replacing the content of said 
fist recording times (F_RECTM) by said record- so 
ing time (RECTM) and recording thereof. 

6. computer-readable storage medium according to 
claim 5, characterized in that said procedure fur- 
ther comprises the steps of: ss 

comparing a recording time (RECTM) of said 
still picture data (VOB) with said last recording 



times (L_RECTM) stored in said still picture 
group management information (VOBGI) cor- 
responding to the stiil picture group (VOBG) be- 
longing to said still picture data (VOB); and 
if said recording time (RECTM) is later 
(RECTM> L_ RECTM) than said last recording 
time (L_RECTM) r replacing the content of said 
last recording times (L_ RECTM) by said re- 
cording time (RECTM) and recording thereof. 
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f 1035 
^1036 
.1037 



.1038 



| V_AA_I 


VOBIJD (V_AA_IJD) (1 BYTE) 


\ 


V_SIZE (1 BYTE) 


AA_I_PTR (2 BYTES) 



V_OA_AA_l 


VOBIJD (V_OA_AAJJD) (1 BYTE) 


\ 


VJ5IZE (1 BYTE) 


OAJ5IZE (2 BYTES) 


OA_PTM (2 BYTES) 


AAJJTR (2 BYTES) 



^,1039 
r 1040 
.1041 



1042 
r 1043 
^1044 
^1045 
.1046 



(e) EXAMPLE OF VOBIJD DATA STRUCTURE 
1033,1035,1039,1042 

b7 b6 b5 b4 b3 b2 b1 bO 1047 



VOBIJD 


TY PP| RESERVED 


TY (TYPE).. 


. "00": VJJD 




"01":V_OA_IJD 




•10":V_AAJJD 




"11":V_OAJ^AJJD 



PP (PLAYBACK PERMISSION) .. 



•0": PLAYBACK IS PERMITTED. 
"1": PLAYBACK IS PROHIBITED. 
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FIG. 15 
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FIG. 17 



1065 
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FIG. 19 



START OF STILL PICTURE PL AYBACK 



f 



1082 



DECIDE VOBGI WHICH IS PLAYED BACK 



y 



1083 



.1084 



SET FIRST VOBI AS A TARGET 



Y 



1085 



PLAYBACK V_PART WHICH CORRESPONDS 
TO THE TARGET VOBI 



1086 
V 



1087 
V 



< 



V_l 



PLAY BACK 
OA_PART 



If 



PLAY BACK 
AA_PART 



if 



WHICH T YPE IS THE TARGET VOBI ? 

^V-OAJ 108 8 |V-AA_I 108 9 |v_OA_AA_l 



playback 
oa_partorP 

AA_PART 
ZZ5 



1090 



IS THE TARGET VOBI T HE LAST VOBI ? 

^NO~ 



1091 



PLAY BACK VOBS IN 
THE SAME ORDER AS 
VOBIS IN VOBLTABLE 



YES 



SET THE NEXT VOBI 
AS THE NEXT TARGET 

1 



1092 



f 



END OF STILL PICTURE PLAYBACK 



1093 



31 



EP 1 204 269 A1 



FIG. 20 



MONITOR 101001 




2 



DRIVE 101006 



32 



EP 1 204 269 A1 



J 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP Gl 13 0839 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
ol relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (MI.CI.7) 



i Y 
A 



EP 0 802 688 A (HITACHI LTD) 
22 October 1997 (1997-10-22) 

* the whole document * 

PATENT ABSTRACTS OF JAPAN 

vol. 016, no. 583 (P-1462), 

22 December 1992 (1992-12-22) 

& JP 04 232662 A (FUJI PHOTO FILM CO LTD), 

20 August 1992 (1992-08-2G) 

* abstract * 

EP 0 599 466 A (SONY CORP) 
1 June 1994 (1994-06-01) 

* the whole document * 

EP 0 753 854 A (PIONEER ELECTRONIC CORP) 
15 January 1997 (1997-01-15) 

* column 2, line 45 - column 8, line 2 * 

PATENT ABSTRACTS OF JAPAN 
vol. 018, no. 445 (P-1789), 
18 August 1994 (1994-08-18) 
& JP 06 139287 A (TOSHIBA CORP), 
20 May 1994 (1994-05-20) 

* abstract * 

PATENT ABSTRACTS OF JAPAN 
vol. 018, no. 017 (E-1488), 
12 January 1994 (1994-01-12) 

6 JP 05 252495 A (NIPPON HOSO KYOKAI), 
28 September 1993 (1993-09-28) 

* abstract * 

US 5 128 774 A (TAKAYAMA MAKOTO) 

7 July 1992 (1992-07-07) 

* abstract * 



-/-- 



1,3,5 
2,4,6 
1.3,5 



1-6 



1-6 



1-6 



1-6 



1-6 



The present search report has been drawn up for all claims 



H04N1/21 



TECHNICAL FIELOS 
SEARCHED (tnt.CI.7) 



H04N 



Place of search 

BERLIN 



Oala ol completion ol the search 

12 March 2002 



Greve, M 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant il taken abne 

Y ; particularly relevant if combined with another 

document of the same category 
A : technological background 
O : non-written disclosure 
P : intermediate document 



T : theory or princpla underlying ihe invention 
E : earlier patent document, but published on. or 

alter the tiling date 
D : document cited in the application 
L : document cited lor other reasons 

& : member of the same patent lamily, corresponding 
document 



33 



EP 1 204 269 A1 



J 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 01 13 G839 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category; 



Citation of document with indication, where appropriate, 
_ of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (lntCL7) 



EP 0 678 816 A (CANON KK) 

25 October 1995 (1995-10-25) 

* column 1, line 1 - column 4, line 26 * 



1-6 



TECHNICAL FIELDS 
SEARCHED (lnt.CI.7) 



The present search report has been drawn up for all claims 



P'ace oi search 


Date of comptotion o< tho search 


Examiner 


BERLIN 


12 March 2802 


Greve, M 



CATEGORY OF CITKD DOCUMENTS 

X : particularly relevant H taken alone 

Y : particularly relevant if combined with another 

document of the same category 
A : technological background 
0 : non-written disclosure 
P : intermediate document 



T : theory or principle underlying the invention 
H : earlier patent document, but published on. or 

after the filing date 
D : document cited in the application 
1. : document cried for other reasons 



& : member of the same patent family, corresponding 
document 



34 



EP 1 204 269 A1 

v 



ANNEX TO THE EUROPEAN SEARCH REPORT 

ON EUROPEAN PATENT APPLICATION NO. EP 01 13 0839 



This annex lists ihe patent family members relating to the patent documents cited in the abavo-mentionod European search report. 
The members are as contained in the European Patent Office E DP file on 

The European Patent Office is in no way liable tor these particulars which are merely given for the purpose of information. 

12-03-2002 





Patent document 


Publication 


Patent family 


Publication 




cited in search report 


date 


member(s) 


date 



EP 0802688 A 22-10-1997 JP 18004535 A 06-01-1998 

EP 0802688 A2 22-10-1997 

US 2001006579 Al 05-07-2001 

US 6226449 Bl 01-05-2001 



JP 04232662 


A 


20-08- 


•1992 


NONE 






EP 0599466 


A 


01-06- 


■1994 


JP 


6119388 A 


28-04-1994 










DE 


69319070 Dl 


16-07-1998 










0E 


69319070 T2 


08-10-1998 










EP 


0599466 Al 


01-06-1994 










US 


6081251 A 


27-06-2000 



EP 0753854 A 15-01-1997 JP 9027170 A 28-01-1997 

EP 0753854 A2 15-01-1997 

US 6160951 A 12-12-2000 

US 5787222 A 28-07-1998 



JP 06139287 A 20-05-1994 US 5440607 A 08-08-1995 



JP 05252495 A 28-09-1993 NONE 



US 5128774 A 07-07-1992 JP 2165490 A 26-06-1990 

JP 2621451 B2 18-06-1997 



EP 0678816 A 25-10-1995 JP 3149309 B2 26-03-2001 

JP 7296001 A 10-11-1995 

JP 8110911 A 30-04-1996 

EP 0678816 A2 25-10-1995 

US 5805215 A 08-09-1998 



o 

& For more details about this annex : see Official Journal of the European Patent Office. No. 12/B2 



35 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



